Exploratory Analysis of Benchmark Experiments – An Interactive Approach
نویسندگان
چکیده
The analysis of benchmark experiments consists in a large part of exploratory methods, especially visualizations. In Eugster et al. [2008] we presented a comprehensive toolbox including the bench plot. This plot visualizes the behavior of the algorithms on the individual drawn learning and test samples according to specific performance measures. In this paper we show an interactive version of the bench plot can easily uncover details and relations unseen with the static version.
منابع مشابه
Exploratory and Inferential Analysis of Benchmark Experiments
Benchmark experiments produce data in a very specific format. The observations are drawn from the performance distributions of the candidate algorithms on resampled data sets. In this paper we introduce a comprehensive toolbox of exploratory and inferential analysis methods for benchmark experiments based on one or more data sets. We present new visualization techniques, show how formal non-par...
متن کاملBench Plot and Mixed Effects Models: First steps toward a comprehensive benchmark analysis toolbox
Benchmark experiments produce data in a very specific format. The observations are drawn from the performance distributions of the candidate algorithms on resampled data sets. In this paper we introduce new visualisation techniques and show how formal test procedures can be used to evaluate the results. This is the first step towards a comprehensive toolbox of exploratory and inferential analys...
متن کاملDomain-Based Benchmark Experiments: Exploratory and Inferential Analysis
Benchmark experiments are the method of choice to compare learning algorithms empirically. For collections of data sets, the empirical performance distributions of a set of learning algorithms are estimated, compared, and ordered. Usually this is done for each data set separately. The present manuscript extends this single data set-based approach to a joint analysis for the complete collection,...
متن کاملBenchmark experiments: a tool for analyzing statistical learning algorithms
Benchmark experiments nowadays are the method of choice to evaluate learning algorithms in most research fields with applications related to statistical learning. Benchmark experiments are an empirical tool to analyze statistical learning algorithms on one or more data sets: to compare a set of algorithms, to find the best hyperparameters for an algorithm, or to make a sensitivity analysis of a...
متن کاملValidity & reliability of the Persian version of Grasha-Richmann student learning styles scale
Introduction: The present study aimed to investigate the psychometricproperties of Grasha-Riechmann Student Learning Styles Scale.Method: The participants included 1039 students (421 students in human and 618 students in technical sciences), selected through the stratified sampling method from Tehran University. They answered the Grasha-Riechmann student learning style scale and the data was an...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009